Information-Theoretic Analysis of Memoryless Deterministic Systems
نویسندگان
چکیده
منابع مشابه
Information-Theoretic Analysis of Memoryless Deterministic Systems
The information loss in deterministic, memoryless systems is investigated by evaluating the conditional entropy of the input random variable given the output random variable. It is shown that for a large class of systems the information loss is finite, even if the input has a continuous distribution. For systems with infinite information loss, a relative measure is defined and shown to be relat...
متن کاملInformation Theoretic Analysis of Cognitive Radio Systems
Cognitive radios have recently emerged as a prime candidates for exploiting the increasingly flexible licensing of wireless spectrum. Regulatory bodies have come to realize that most of the time, large portions of certain licensed frequency bands remain empty [17]. To remedy this, legislators are easing the way frequency bands are licensed and used. In particular, new regulations would allow fo...
متن کاملInformation theoretic analysis of watermarking systems
Watermarking models a copyright protection mechanism where an original data sequence is modi ed before distribution to the public in order to embed some extra information. The embedding should be transparent (i.e., the modi ed data should be similar to the original data) and robust (i.e., the information should be recoverable even if the data is modi ed further). In this thesis, we describe the...
متن کاملAnalysis of Biological and Chemical Systems Using Information Theoretic Approximations
The identification and quantification of high-dimensional relationships is a major challenge in the analysis of both biological and chemical systems. To address this challenge, a variety of experimental and computational tools have been developed to generate multivariate samples from these systems. Information theory provides a general framework for the analysis of such data, but for many appli...
متن کاملOn the Rate of Information Loss in Memoryless Systems
In this work we present results about the rate of (relative) information loss induced by passing a real-valued, stationary stochastic process through a memoryless system. We show that for a special class of systems the information loss rate is closely related to the difference of differential entropy rates of the input and output processes. It is further shown that the rate of (relative) inform...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Entropy
سال: 2016
ISSN: 1099-4300
DOI: 10.3390/e18110410